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Using as a model the Learning Assistance Center at California State 
University, Long Beach, we can describe a Learning Assistance Center as 
a support, delivery, and referral service for the entire campus community : 
students, faculty, staff, and administrators. There are three major 
aspects to its services — personal learning skills, Academic Aids, and 
support of faculty instruction. Assistance iS given in these three areas 
through a systems approach. Briefly and conciseTy, the CSULB Learning 
Assistance Center is t.otally learner-centered with a diagnostic/prescriptive 
rationale thai considers learning to be individualistic, mathemagen ic , 
personalized, and cybernatic (9, 10). 

It is the latter aspect of a LAC--the cybernetic aspect within a 



^ 

1^ systems approach to i ns truct ion~-v/hIch v/ill be the focus of this paper. 

More specifically, we will discuss data collection and analysis as a 



cybernetic 'ispccl of a Lcorr, ing Ajsibl^nce Center. 

Cybernet ic5 and Accountabi I i ty 

In 3 recent ERIC poper that overviev^s systoni's literature, Twelker and 
others define o systems approach to instruction as , • a systematic 
way of identifying, developing and evaluating a set of rraterials and 
strategies aimed at accomplishing a particular educational goaL'» (27:0 

Banathy, a major proponent of a systems approach to instruction, 
points out that cybernetic data or . . continuous feedback of perform- 
ance data into the system, . . " is critical . , for the purpose of 
making adequate adjustments in the system," (4:82) 

He further states that: 

The self-adjusting characteristics of systems development 
prescrioe change as a perpetual process in the development, 
operation, and maintenance of systems. We can safety say 
that the only valid means of maintaining a svstem is by 
purposely changing it, (4:82) 

For quality control (4:90) a Learn i ng Ass i s tance Center must have incor- 
porated within its system a mechanism for continuous feedback, ongoing 
analysis of that feedback, and means for adjusting and changing the 
system where appropriate. In fact, all the three primary actions of a 
system — problem definition and organization, system analysis and develop- 
ment, and system evaluation — are interrelated by feedback built in the 
system (2/) . 

In terms of accountability being concerned with effectiveness and 
efficiency, a Learning Assistance Center is held accountable through 
this cybernetics approach to systems. This allows the LAC to be account- 
able not only to itself as a system and a program, but also to be 



account'iblo to Its Ictarners r^nJ homing T ici ^ I '.ritorb, the ccjipus ft 
services, its sponsoring agency, and to other Learn i ng Aj3 i stance Centers 

Irproved ddto coll^jction, analysis, and subsequent chanr;?s vilthin 
the systefTi are required for improved accountability. Agj^ncies /jt all lev 
--federal, state, local, and campus--are cfemandlng increased efficiency 
in the use of resources for improved accountability. An excellent 
reference on accountability for LAC personnel is MetfessrPs and Hammond' 
paper entitled "Everything You*ve Always Wanted to Know About Behavioral 
Objectives But Were Afraid to Ask, or How to Develop Accountability 
Programs in the Affective Domain.*' (18) 

Further, Nita Myers Earnheart, a learning practitioner Involved 
viith UCLA's Learning Center, in a recent paper warns us that '*The word 
accountabi 1 i ty is Increasingly in the campus air, hanging particularly 
heavy over the heads of those student services concerned with learning 
problems and techniques.'* (13:3M 

Literature and Research 
Although the literature contains many surveys and descriptions of 
Learning Centers and their programs (3, 5» 6, 11, 15, 20, 26, 29), little 
can be found that discusses data collection and analysis to derive 
accountability. Bleismer documents this in his most recent available 
review of the literature, "1971 Review of Research on College-Adult 
Reading," He states that "Purposes for presenting a number of programs 
at this conference (J^atlonal Reading Conference^ last year v;ere mainly 
ones of description (Cartwright, 1970; Christ, 1970; Ewing, 1970); but 
some z]so included reports of evaluations to some extent." (8:299) 
Bleismer further states that "The contents [of the proceedings of the 



Western Coll*.*^^ Read i ng Assoc iat ion * 5 Fourtn Annual Conference) appeared 
to be rain!y descriptions of specific prograns in the WCRA area; but sev- 
eral included evaluation reports or other research aspects. . (8:298) 
Bleisfper alludes nere to the papers by Adams (I), Biggs, and others (7), 
Hagstron (1^+), and Re id (2^+) . 

A further search of the I'.erature indicates that there were six 
articles that treated accoun tab M i ty v/i th reference to learning assistance 
programs. Among these were two by Martha Maxwell (16, 17), one by 
Stafford North (21), one by Chester Tillman (25), one by Deborah K. 
Osen (23), and one by Drexler and Pepper (12). 

In this last paper, Drexler and Pepper caution "... that the 
most commonly used criterion of success of a program can often be mis- 
leading. . . " (12; 19^) This warning refers to the current practice of 
evaluating and discussing program effectiveness as it centers around 
assessment of the total program. We must remember that a program is 
comprised of several components. We must also remember that each of 
these components should be assessed separately with the understanding 
that they interface with one another. An overall program evaluation 
leads only to the evaluation of the program, not to the evaluation of 
its component parts. An evaluation of separate programs and activities 
in a Learning Assistance Center as parts affecting the total system can 
lead us then to accountability of each specific component. 

Gathering Sensor Data 
Let's turn now to a discussion of some practical means for gathering 
sensor data that assesses Learning Assistance Center programs and activi- 
ties. The suggestions given below have been successfully employed at 
CSULB's Learning Assistance Center. Only three aspects of the Center's 
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total /s^rent procedure will b\i corio i dared; 1) usoge of the Center, 
2) u'Jrage of the naterialci in the Ccp.rer, and 3) usefulness of the material 
to the learners in the Center. 

Evaludtiop Aspect fH: Usage of the Center 

To determine usage of the Center, v;e are presently using a fern 
which we have labeled the "Sign-in Sheet." Every entrant to the LAC 
is asked to sign-in. In the appropriate spaces provided, the entrant 
prints his name, enters his student ID number, checks his campus status 
(freshman, sophomore, junior, senior, graduate, EOP, faculty, staff, or 
visito-), and further, if a student, gives the course number and faculty 

^r.ber fror, v;hose class he was referred, or If a faculty, staff, or 
visitor, gives his school, department, and position. 

Several graphs of usage of the Center are kept from the data 
provided by the "Sign-in Sheet." First, a day-by-day graph, and at 
least once a semester, an hour intervaJ graph, is kept of the number 

persons entering the Center. In this manner the Center's personnel 
determine the peak days and hours of operation and the Supervisor 
schedules her staff's work hours accordingly. 

Second, a month-by-month tally of users, broken down into the 
categories of campus status, illustrates the increase or decrease in 
overall and categorical usage of the Center. Of course, this is senso: 
data which becomes optimally useful only when the LAC staff asks itself 
the reasons for the appearance of the data. 

Ei^aluation Aspect #2: Usage of the Materials in the Center 

We have employed at our LAC another form which provides usage data 
on materials — the "Check-out S!!p." All materials within our Center are 
Q checked-out on this si in. A month-by-month tally of the check-out slips 

ERIC 



providi,-:^ the U\Z ^tiff ^vith on accurate co^jot of the ni^nber of t\TV2b 
any piece of 5oftv;are was used in the Center, and also on accurate 
count of the number of tines each specific item of 5oft\N'ar<* v/as U3ed 
in the Ccrnter, This sensor lata is analyjed by the LAC staff on a 
bifTionthty basis. During these assessment meetings the question is 
asked: "Why is Wordcraft/1 being used more often than Wordcraf t/2?** 
This process of assessment of materials usage in conjunction with an 
assessment of material usefulness (see ''Evaluation Aspect ^3: Usefil- 
ness of the Material to the Learners in the Center," this paper) leads 
to many effects. For example, in some cases. It culminates in the buy- 
ing or production of more programs of the type that are proving them- 
selves cost-effective, and in other cases It leads to the steering 
away from those programs which are not proving themselves cost-effect iv$. 
Another result of the assessment procedure is the encouragement on the 
part of the LAC staff of greater utilization of present programs (encour- 
agement, on one hand, might simply mean making the program more access ibl 
or, on the other hand, publicizing the program). Another effect which 
often arises out of the analysis of usage of a specific program leads to 
the adaptation of that program for greater usefulness. 

Evaluation Aspect #3; Usefulness o^ the Material to the Learners in the 
Center 

Further data Is collected from the "Check-out Slip;" this data is 
in terms of usefulness of the material to the learner. The learner upon 
returning his checked-out materials to the LftC aide is requested by the 
aide to check both the content and format usefulness of the material on a 
three-point scale — very helpful, somewhat helpful, and not at all helpful 
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At tHc bottom of-* this slip a space provided for further co.T^nts. 

This information also tallied once a month and the results 
are revieweri on a bimonthly basis. /^Mention should be nkide here that 
at the present time we arc in the process ofl setting up a computer program 
which will tally this sensor data.) If, in the process of scrutinizing 
the results from this data collection, It is noted that a particular 
program's content and/or format is Judged by many learners as not at a'1 
useful, the LAC staff attempts to evaluate the 'Vhy?'* The ^nsv^er to 
this question is often found within the learner's file folder on the 
^'Activities Log and Response Sheet," Every regular user of the Center 
Is provided with this sheet for logging his activitips in the Center 
and making responses to them. Also, the LAC staff member/counselor 
vvho interfaces v;ith the learner makes written responses on this same 
sheet to the learner's reactions and comments. This is in addition 
to the regularly weekly scheduled appointment between the learner and 
his lA Counselor. From this response column the Center derives more 
data on the usefulness of its materials. 

Conclusions and Orle Step Beyond 
We have only examined a few of the methods employed at CSULB's 

LAC to measure the effectiveness of some of the Center^s component parts. 

For a more comprehensive and d'itailed account of assessing learner programs . 

refer to Nicholas J. AnstasJow's article ''Measuring Change—A Time Oimensron- 

al Problefn" (2) and M^^tfassel's and Michael^o paper f'Hultlple Criterion 

Measures for Evaluation of School Programs*' (19).. ^ 

U is admittedly true that the assessment methods described above 

reciutre ^ considerable amount of time and effort on the part of the LAC 

staff and its learners, but the re\iard of accountability and 

O 
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siibsetjutrnt 1y the obility to upqr^de an o*)erotion fr(jn ih^ data gatht?rcti 
IS certainly 'weJ I worth It. In fact, being c-^ware of this cybernettc 
aspect of n^sessir.ent of a systLTi is a must for any systems approach. 
Tv;el!;er and others remird us that ''If evaluation techniques are not a 
prominent part of the proposed procedures (of a systems approach], either 
the approach is weak or It is not a systems approach. Evaluation tech- 
niques along vn'th the careful statement of objectives are critical parts 
of any * usefu I * sys temat ic approach." (27:10) 

It is also admittedly true that the record-keeping activities 
which we have discussed are not psychometr ical ly sophisticated. However, 
they are a novecent toward more accountability within Learn ing Ass istance 
Centers. They ar» certainly better than the informal evaluations based 
on opinion and intuition which unfortunately seem to be more represent- 
ative of evaluations in this area. O'Hare and Lasser, in a recently 
Dublished nonograpK: • Pvalna Mng Pnpi 1 Pf>r<;nnngl Program*; (22t 20-21), 
conceptualize evaluation and evaluative research on a continuum (Fig. 1). 

Figure 1 

Program Evaluation — Research Continuum (22:21) 
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The leMSt sophisticated l2vc1 of prr>r;ro.T» evjluat'on \/o ? I^S^ornal 
cvi1u3tions b«)sed on opinion '3nd intuit io-^. Th's lov^ is r»uc:*Geded by 
a level represented by dcitj collecting, adni n i ^ trat i/c* reporting, and 
reporting envi ronnenta I characteristics such os physical facilities or 
counseling techniques used. The gathe: ing of sensor riita which v^e out- 
lined above falls at this level. The other extreme of the continuum is 
represented by evaluative research — designs which ottefn;.t to relate 
envirornent, pupil, and behavior change. Philosophically and theoretic- 
ally nany persons involved with fearning have alrccidy reached this rost 
sophisticated level of evaluation. John A. Wood and Anne Marie Sernazz 
Haar*, in an article published in the Twenty-Fir>t Yearbook of the 
National Reading Conference, broached this subject when they stated 
that: 

Instructional methods oS well as educational environment differ 
and these differences interact vn th personal variables of the 
learner to either facilitate or inhibit learning. • . Insufficient 
attention has been paid to specific learner characteristics and 
their effect in specific learning situations. Without this 
knowledge, attempts at individualized instruction are limited 
to broad concepts which do little to adjust the educational climate 
so that it can accoirinodate specific learner characteristics and 
maximize learning. Instead of predicting main efforts between 
treatments, we must begin predicting Interactions based on our 
knowledge of sociological, persona logica I and methodological 
factors that affect learning (30:161-162). 

Thus, there is a felt need for practical suggestions to be made regarding 

assessment and evaluation of what Leiand Kaiser labels (28) »'the ecosystem." 

We need as Learning Assistance practitioners and directors to go one step 

beyond implementation of just a systems approach and to begin thinking 

and acting in terms of an ecological systems approach. 
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